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Abstract 

The design of optimal disturbance accommodation and servomecha- 
nism controllers with limited plant model information is considered in this 
paper. Their closed-loop performance are compared using a performance 
metric called competitive ratio which is the worst-case ratio of the cost of 
a given control design strategy to the cost of the optimal control design 
with full model information. It was recently shown that when it comes to 
designing optimal centralized or partially structured decentralized state- 
feedback controllers with limited model information, the best control de- 
sign strategy in terms of competitive ratio is a static one. This is true 
even though the optimal structured decentralized state- feedback controller 
with full model information is dynamic. In this paper, we show that, in 
contrast, the best limited model information control design strategy for 
the disturbance accommodation problem gives a dynamic controller. We 
find an explicit minimizer of the competitive ratio and we show that it is 
undominated, that is, there is no other control design strategy that per- 
forms better for all possible plants while having the same worst-case ratio. 
This optimal controller can be separated into a static feedback law and 
a dynamic disturbance observer. For constant disturbances, it is shown 
that this structure corresponds to proportional-integral control. 

1 Introduction 

Recent advances in networked control systems have created new opportunities 
and challenges in controlling large-scale systems composed of several interacting 
subsystems. An example of a networked control system is shown in Figure [1] 
where Pi denotes the subsystems to be controlled and Ci denotes the controllers. 
The interactions between the subsystems and the controllers as well as the ex- 
ternal disturbances and references are indicated by arrows. For such networked 



*The work of F. Farokhi and K. H. Johansson were supported by grants from the Swedish 
Research Council and the Knut and Alice Wallenberg Foundation. The work of C. Lang- 
bort was supported, in part, by the 2010 AFOSR MURI "Multi-Layer and Multi-Resolution 
Networks of Interacting Agents in Adversarial Environments" . 

1 ACCESS Linnaeus Center, School of Electrical Engineering, KTH Royal Institute of Tech- 
nology, SE-100 44 Stockholm, Sweden. E-mails: {farokhi, kallej}@ec. kth.se 

* Department of Aerospace Engineering, University of Illinois at Urbana-Champaign, Illi- 
nois, USA. E-mail: langbort@illinois.edu 



1 



systems, many researchers have considered the problem of decentralized or dis- 
tributed stabilization or optimal control as well as the effect of communication 
channel limitations on closed-loop performance [TUTU]. However, at the heart of 
all these methods lies the (sometimes implicit) assumption that the designer has 
access to the global plant model information when designing a local controller. 
This assumption might not be warranted, however, in some applications of in- 
terest [HJQ2, m which the designer is constrained to compute local controllers 
for a large-scale systems in a distributed manner with access to only a limited 
or partial model of the plant. This might be due to several reasons, for example, 
(i) the designer wants the parameters of each local controller to only depend on 
local model information, so that the controllers do not need to be modified if the 
model parameters of a particular subsystem, which is not directly connected to 
them, change, (ii) the design of each local controller is done by a designer with 
no access to the global model of plant since at the time of design the complete 
plant model information is not available or might change later in the design 
process, or (Hi) different subsystems belong to different individuals who refuse 
to share their model information since they consider it private. These situations 
are very common in practice. For instance, a chemical plant in process industry 
can have thousands of proportional-integral-derivative controllers. These pro- 
cesses well illustrate Case (0), as the tuning of each local controller does not 
typically require model information from other control loops in order to sim- 
plify the maintenance and limit the controller complexity. Case @ is typical for 
cooperative driving such as vehicle platooning, where each vehicle has its own 
local (cruise) controller which cannot be designed based on model information 
of all possible vehicles that it may cooperate with in future traffic scenarios. 
Case ([mf can be also illustrated by the control of the power grid, where eco- 
nomic incentives might limit the exchange of network model information across 
regional borders. Therefore, we have started investigating the concept of limited 
model information control design for large-scale systems |13H16) . 

Control design strategies, mappings from the set of plants of interest to 
the set of applicable controllers, with various degrees of model information are 
compared using the competitive ratio as a performance metric, that is, the 
worst-case ratio of the cost of a given control design strategy to the cost of the 
optimal control design with full model information. In control design with lim- 
ited plant model information, we search for the "best" control design strategy 
which attains the minimum competitive ratio among all limited model informa- 
tion design strategies. As this minimizer might not be unique, we further want 
to find an undominated minimizer of the competitive ratio, that is, there is no 
other control design strategy in the set of all limited model information design 
strategies with a better closed-loop performance for all possible plants while 
maintaining the same worst-case ratio. Recent attention has been on limited 
model information design methods that produce centralized or decentralized 
static state-feedback controllers with specific structure. This was justified, at 
first, by being the simplest case to explore [T^HTS] . and then, maybe more sur- 
prisingly, by the recently proven fact that the "best" (in the sense of competitive 
ratio and domination) state-feedback structured H2- controller for a plant with 
lower triangular information pattern that can be designed with limited model 
information is also static [16] , even though the best such controller constructed 
with access to full model information is dynamic [5JIS]- In this paper, we study 
the problem of limited model information control design for optimal disturbance 
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accommodation and servomechanism, and show that, contrary to the situations 
mentioned above, the "best" limited model information design method gives dy- 
namic controllers. Optimal disturbance accommodation is a meaningful model 
for problems such as constant disturbance rejection or step reference tracking, 
and has been well-studied in the literature [T7H2T] , but with no attention being 
paid to the model information limitations in the design procedure. 

In this paper, specifically, we consider limited model information control de- 
sign for interconnection of scalar discrete-time linear time-invariant subsystems 
being affected by scalar decoupled disturbances with a quadratic separable per- 
formance criterion. The choice of such a separable cost function is motivated 
first by the servomechanism and disturbance accommodation literature [17H21j , 
and second by our interest in dynamically-coupled but cost-decoupled plants and 
their applications in supply chains and shared infrastructure [HJIH] which has 
been shown to be well-modeled in this fashion. The assumptions on scalar sub- 
systems and scalar disturbances are technical assumptions to make the algebra 
in the proofs shorter. Since we want each subsystem to be directly control- 
lable (so that designing subcontrollers based on only local model information is 
possible), we assume that the overall system is fully-actuated. 

We start with the case that each subcontroller is only designed with the cor- 
responding subsystem model information. We prove that, in the case where the 
plant graph contains no sink and the control graph is a supergraph of the plant 
graph, the so-called dynamic deadbeat control design strategy is an undomi- 
nated minimizer of the competitive ratio. For any fixed plant, the controller 
given by the deadbeat control design strategy can be separated into a static 
feedback law and a dynamic disturbance observer. For constant disturbances, 
it is shown that this structure corresponds to a proportional-integral controller. 
However, the deadbeat control design strategy is dominated when the plant 
graph has sinks. We present an undominated limited model information control 
design method that takes advantage of the knowledge of the sinks' location to 
achieve a better closed-loop performance. We further show that this control 
design strategy has the same competitive ratio as the deadbeat control design 
strategy. Later, we characterize the amount of model information needed to 
achieve a better competitive ratio than the deadbeat control design strategy. 
The amount of information is captured using the design graph, that is, a di- 
rected graph which indicates the dependency of each subcontroller on different 
parts of the global dynamical model. It turns out that, to achieve a better 
competitive ratio than the deadbeat control design strategy, each subsystem's 
controller should, at least, has access to the model of all those subsystems that 
can affect it. 

This paper is organized as follows. We formulate the problem and define 
the performance metric in Section [5J In Section [21 we introduce two specific 
control design strategies and study their properties. We characterize the best 
limited model information control design method as a function of the subsystems 
interconnection pattern in Section 01 In Section [5j we study the influence of 
the amount of the information available to each subsystem on the quality of 
the controllers that they can produce. We discuss special cases of constant- 
disturbance rejection, step-reference tracking, and proportional-integral control 
in Section [6] Finally, we end with conclusions in Section [7] 
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Figure 1: Illustrative example of a networked control system. 



1.1 Notation 

The set of real numbers and complex numbers are denoted by R and C, re- 
spectively. All other sets are denoted by calligraphic letters, such as V and A. 
Particularly, the letter TZ denotes the set of proper real rational functions. 

Matrices are denoted by capital roman letters such as A. Aj will denote 
the j th row of A. Afj denotes a submatrix of matrix A, the dimension and the 
position of which will be defined in the text. The entry in the i th row and the 
j th column of the matrix A is oy. 

Let <S>" + («Si ) be the set of symmetric positive definite (positive semidefmite) 
matrices in R™ xn . A > (>)0 means that the symmetric matrix A £ R™ xn is 
positive definite (positive semidefmite) and A > (>)B means that A—B > (>)0. 

g_{Y) and W(Y) denote the smallest and the largest singular values of the 
matrix Y, respectively. Vector a denotes the column-vector with all entries 
zero except the i th entry, which is equal to one. 

All graphs considered in this paper are directed, possibly with self- loops, 
with vertex set {1, ...,q} for some positive integer q. If G = ({1, ...,q},E) is a 
directed graph, we say that i is a sink if there does not exist j ^ i such that 
£ E. The adjacency matrix S £ {0,l} qXq of graph G is a matrix whose 
entries are defined as sy = 1 if (j, i) £ E and sy = otherwise. Since the set 
of vertices is fixed for all considered graphs, a subgraph of a graph G is a graph 
whose edge set is a subset of the edge set of G and a supergraph of a graph G 
is a graph of which G is a subgraph. We use the notation G' D G to indicate 
that G' is a supergraph of G. 



2 Mathematical Formulation 
2.1 Plant Model 

We are interested in discrete-time linear time- invariant dynamical systems de- 
scribed by 

x(k + 1) = Ax{k) + B{u{k) + w(k)) ; x(0) = x , (1) 

where x(k) £ 1" is the state vector, u(k) £ R" is the control input, w(k) £ 
R™ is the disturbance vector and A £ R™ xn and B £ R" xn are appropriate 
model matrices. Furthermore, we assume that the dynamic disturbance can be 
modeled as 

w(k + l) = Dw{k) ■ iu(Q) =w , (2) 
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where wq G R™ is unknown to the controller (and the control designer). Let a 
plant graph Gp with adjacency matrix Sp be given. We define the following 
set of matrices 

A{S r ) ={4e R nx ™ | aij = for all 1 < i,j < n such that (s v )ij = 0}. 

Also, let us define 

B{e) = {Be R nxn | a{B) > e, \ 3 = for all 1 < i ^ j < n}, 

for some given scalar e > and 

V = {De K" xn | dij = for all 1 < i ^ j < n}. 

Now, we can introduce the set of plants of interest V as the set of all discrete- 
time linear time-invariant systems ©-© with A € _4(Sp), B e B(e), D e V, 
xq G M. n and wo £ M. n . With a slight abuse of notation, we will henceforth 
identify a plant P e V with its corresponding tuple (A, B, D,xq,wq). 

The variables x.^ G M, iti G M, and Wi G M are the state, input, and distur- 
bance of scalar subsystem i whose dynamics are given by 

n 

Xi(k + 1) = ajjXj(k) + bii(uj(k) + w l (k)), 

3 = 1 

Wi(k + 1) = duWiik). 

We call G-p the plant graph since it illustrates the interconnection structure 
between different subsystems, that is, subsystem j can affect subsystem i only 
if (j, i) G Ep. Note that we assume that the global system is fully-actuated; 
i.e., all the matrices B G B(e) are square invertible matrices. This assumption 
is motivated by the fact that we need all subsystems to be directly controllable. 
Moreover, we make the standing assumption that the plant graph Gp contain 
no isolated node. There is no loss of generality in assuming that there is no 
isolated node in the plant graph Gp, since it is always possible to design a 
controller for an isolated subsystem without any model information about the 
other subsystems and without influencing the overall system performance. Note 
that, in particular, this implies that there are q > 2 vertices in the graph because 
for q = 1 the only subsystem that exists is an isolated node in the plant graph. 

Figure [DJa) shows an example of a plant graph Gp. Each node represents 
a subsystem of the system. For instance, the second subsystem in this example 
affects the first subsystem and the third subsystem, that is, submatrices A12 and 
A32 can be nonzero. Note that the first subsystem in Figure [Ha) represents a 
sink of Gp. The plant graph G' v in Figure [Ha') has no sink. 

2.2 Controller Model 

The control laws of interest in this paper are discrete-time linear time-invariant 
dynamic state-feedback control laws of the form 

x K (k + l) = A K x K (k) + B K x{k) ; x K (0) = 0, (3) 
u{k) = C K x K (k) + D K x(k). (4) 



■5 



(a)G, 



(b) G K 



(c) G c 



** n 



G 

GO g; (b') g' k 





OF 

(c') G^, 



Figure 2: G-p and G' v are examples of plant graphs, G/c and are examples 
of control graphs, and Gc and G' c are examples of design graphs. 
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Each controller can also be represented by a transfer function 



C K {zI-A K )- l B K +D K , 



where z is the symbol for the one time-step forward shift operator. Let a control 
graph Gx. with adjacency matrix Sx. be given. Each controller K belongs to 

£(Sjc) = {K £ K nxn | kij = for all 1 < i,j < n such that ( S) c)ij = 0}. 

When the adjacency matrix 5*^ is not relevant or can be deduced from context, 
we refer to the set of controllers as K,. Since it makes sense for each subcontroller 
to use at least its corresponding subsystem state-measurements, we make the 
standing assumption that in each design graph G/c, all the self- loops are present. 

An example of a control graph G/c is given in Figure &b) . Each node repre- 
sents a subsystem-controller pair of the overall system. For instance, G/c shows 
that the first subcontroller can use state measurements of the second subsystem 
beside its corresponding subsystem state-measurements. Figure shows a 
complete control graph G' K . This control graph indicates that each subcontroller 
has access to full state measurements of all subsystems, that is, fC(S/c) = lZ nxn . 



2.3 Control Design Methods 



A control design method T is a map from the set of plants V to the set of 
controllers K,. Any control design method Y has the form 



7ii 



7nl 



7lr. 



In 



(5) 



where each entry 7^ represents a map A(S-p) x B(e) xD->K. 

Let a design graph Gc with adjacency matrix Sc be given. We say that Y 
has structure Gc, if for all i, subcontroller i is computed with knowledge of the 
plant model of only those subsystems j such that € Ec- Equivalently, Y 
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has structure Gc, if for all i, the map I\ = [7,1 • • • 7„] is only a function of 
{[aji ■ ■ ■ a,j n ],bjj,djj \ {sc)ij 7^ 0}. When Gc is not a complete graph, we refer 
to r £ C as being a "limited model information control design method" . Since 
it makes sense for the designer of each subcontroller to have access to at least its 
corresponding subsystem model parameters, we make the standing assumption 
that in each design graph Gc, all the self-loops are present. 

The set of all control design strategies with structure Gc will be denoted by 
C, which is considered as a subset of all maps from A(S-p) x B(e) x V to JC(S/c) 
because a design method with structure Gc is not a function of the initial state 
xq or the initial disturbance wo. We use the notation T(A,B,D) instead of 
T(P) for each plant P — (A,B,D,Xq,wo) £ V to emphasize this fact. 

To simplify the notation, we assume that any control design strategy T has 
a state-space realization of the form 



A r (A,B,D) 


B T {A,B,D) ' 


C r {A,B,D) 


D r (A,B,D) 



where A r (A,B,D), B r (A,B,D), C r (A,B,D), and D r (A,B,D) are matrices of 
appropriate dimension for each plant P — (A, B, D, Xq, wq) £ V . The matrices 
Ar(A,B,D) and Cr(A,B,D) are block diagonal matrices since subcontrollers 
do not share state variables. This realization is not necessarily minimal. 

An example of a design graph Gc is given in Figure WL C )- Each node repre- 
sents a subsystem-controller pair of the overall system. For instance, Gc shows 
that the second subsystem's model is available to the designer of the first subsys- 
tem's controller but not the third and the forth subsystems' model. Figure^c') 
shows a fully disconnected design graph G' c . A local designer in this case can 
only rely on the model of its corresponding subsystem. 



2.4 Performance Metric 

The goal of this paper is to investigate the influence of the plant graph on 
the properties of controllers derived from limited model information control 
design methods. We use two performance metrics to compare different control 
design methods, which are adapted from the notions of competitive ratio and 
domination recently introduced in [13H16] . Let us start with introducing the 
closed-loop performance criterion. 

To each plant P = (A, B, D, Xo, wq) £ V and controller K £ IC, we associate 
the performance criterion 
00 

J P {K) = [x(k) T Qx{k) + (u(k) + w(k)) T R{u(k) + w(k))] , (6) 

fc=0 

where Q £ <S? + and R £ 6>" + are diagonal matrices. We make the following 
standing assumption: 

Assumption 2.1 Q = R = I. 

This is without loss of generality because the change of variables (x, u, w) — 
(Q 1 / 2 ^, R 1 / 2 u, R 1 l 2 w) transforms the closed-loop performance measure and state- 
space representation into 

00 

J P (K) = J2 [x(kfx(k) + (u(k) + w{k)) T (u(k) + w(k))] , (7) 

fc=0 
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and 

x(k + l) = Q 1/2 AQ- 1 / 2 x{k) + Q 1 ' 2 BR- 1 ' 2 {u{k)+w{k)) 
= Ax(k) + B(u(k)+w{k)) 7 

without affecting the plant, control, or design graphs, due to Q and R being 
diagonal matrices. 

Definition 2.1 (Competitive Ratio) Let a plant graph G-p, a control graph 
G/c, and a constant e > be given. Assume that, for every plant P £ V , there 
exists an optimal controller K*(P) G JC such that 

J P {K*{P)) < J P {K), VK e /C. 

The competitive ratio of a control design method T is defined as 

, r , J P (T(A,B,D)) 
r v (T) = sup - (K , (m . , 

with the convention that " eguals one. 

Note that the optimal control design strategy (with full plant model infor- 
mation) K* does not necessarily belong to the set C. 

Definition 2.2 (Domination) A control design method T is said to dominate 
another control design method V if 

J P (T(A,B,D))<J P (T'(A,B,D)), V P = (A, B, D,x Q ,w a ) G V, (8) 

with strict ineguality holding for at least one plant in V . When Y 1 G C and no 
control design method T G C exists that satisfies (0), we say that V is undomi- 
nated in C for plants in V ■ 

In the remainder of this paper, we determine optimal control design strate- 
gies 

T* G argminrp(r), (9) 
rec 

for a given plant, control, and design graph. Since several design methods may 
achieve this minimum, we are interested in determining which ones of these 
strategies are undominated. 



3 Preliminary Results 

Before stating the main results of the paper, we introduce two specific control 
design strategies and study their properties. 



3.1 Optimal Centralized Control Design Strategy 

The problem of designing optimal constant input-disturbance accommodation 
control for linear time- invariant continuous-time systems was solved earlier in |19j 
[2Tj . To the best of our knowledge, this was not the case for arbitrary dynamic 
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disturbance accommodation when dealing with linear time-invariant discrete- 
time systems. As we need it later, we start by developing the optimal centralized 
(i.e, G/c is a complete graph) disturbance accommodation controller K*(P) for a 
given plant PeP. First, let us define the auxiliary variables £(fc) = u(k) + w(k) 
and u(k) — u(k + 1) — Du(k). It then follows that 

£0 + 1) = u(k + 1) + w(k + 1) 

= u(k + 1) + Dw(k) 

= Du(k) + Dw{k) + u(k) 

= D£(k)+u(k). (10) 

Augmenting the state-transition in (1101) with the state-space representation of 
the system in |T]) results in 



" x(k + l) ' 




A B 




' x{k) ' 




' " 


. £0 + 1) . 




D 






+ 





u(k). 



Besides, we can write the performance measure in ([7]) as 

oo 

J P {K) = Y J 



k=0 



' x{k) ' 


T 


' x(k) ' 









(11) 



(12) 



To guarantee the existence and uniqueness of the optimal controller K*(P), we 
need the following lemma. 



Lemma 3.1 The pair (A,B), with 
A-- 



A B 
D 



B 



(13) 



is controllable for any given P = (A, B, D,Xq,Wq) G V . 
Proof: The pair (A,B) is controllable if and only if 



[ A- XI \ B ] 



A- XI B 
D - XI 



is full-rank for all A 6 C. This condition is always satisfied since all matrices 
B e B{e) are full-rank matrices. ■ 

Now the problem of minimizing the cost function in (1121) subject to plant 
dynamics in (jllj) becomes a state-feedback linear quadratic optimal control with 
a unique solution of the form 

u{k) =G 1 x(fc)+G 2 £(fc), 

where Gi G R nxn and G 2 £ R" xn satisfy 

[ Gi G 2 ] = -{^XB^^XA 



(14) 



and X is the unique positive-definite solution of the discrete algebraic Riccati 
equation 

A T XB{B T XB)- l B T XA - A T XA + X - / = 0. (15) 
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Therefore, we have 



u(k + l) = Du(k) + u(k) 

= Du{k) + G l x{k) + G 2 t{k). 



(16) 



Using the identity £(fc) = B^ 1 (x(k + 1) - Ax(k)) in ([15]). we get 

u(k+l) = Du{k) + Gix{k) + G 2 i{k) 

= Du(k) + Gix{k) + G 2 B- 1 (x{k + 1) - Ax(k)) 

= Du{k) + (G 1 -G 2 B- 1 A)x(k)+G 2 B- 1 x{k + l). (17) 

Putting a control signal of the form u(k) = xn{k) + DKx(k) in ([TT)) . we get 

x K (k + 1) = L>x^(fc) + {DD K + Gi- G 2 B- 1 A)x(k) + (G 2 B~ 1 - D K )x{k + 1). 

Now, we enforce the condition GiB -1 — Dk = 0, as xx(k + 1) can only be a 
function of x{k) and xk (k), see Therefore, the optimal controller K*(P) 
becomes 

x K (k + l) = DxKi^ + lG^DG^- 1 -G 2 B- 1 A}x(k), 
u(k) = x K (k) + G 2 B- 1 x(k), 

with x K {0) = 0. 

Lemma 3.2 Let the control graph Gjc be a complete graph. Then, the cost of 
the optimal controller K*(P) for each plant P £ V is lower-bounded as 



Jp(K*{P)) > 
where 



xo 
Bw 



' I" W + DWD + D 2 B- 2 -D{W + B- 2 ) 
-{W + B- 2 )D W + B- 2 

W = A T (I + B 2 y 1 A + I. 



x 
Bwq 



Proof: Define 

J P (K,p) 



E 

fc=0 



( 


' ss(jfe) " 


T 


' x(k) ' 








. ^( fc ) . 



pu{k) T u(k) 



and 



tf!(P) = argmin Jp(tf, p). 



Using Lemma 13.11 we know that K* (P) exists and is unique. We can find 
Jp(K*(P),p) using X(p) as the unique positive definite solution of the discrete 
algebraic Riccati equation 

A T X{p)B{pI + B T X(p)B)- 1 B T X(p)A - A T X(p)A + X(p) -1 = 0. (18) 

According to [22], the positive-definite matrix X(p) is lower-bounded by 

X(p)-I > A T (x(p)- 1 



X BB T 



A 



A T (x(p) - X(p)B (pi + B T X(p)B) 1 B T X(pf) A, 
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where 
X(P) 



A T [l + p- 1 BB 1 



A 



A 1 A + 1 



BA 



A T B 



Basic algebraic calculations show that 

X(p) - X(p)B(pI + B T X(p)B)- 1 B T X(p) 
According to [23], we know that 



lim 

p->0 



A T (I + B 2 )- X A + I 




and as a result 



X=\im X(p) > 

p— J-0 



lim J p (K;(P),p) = J P (K*(P)), 







" A 


B ' 


T r 





D 





A B 
D 



(19) 



where X is the unique positive-definite solution of the discrete algebraic Riccati 
equation in (|15[) and consequently 



J P {K*(P)) = 
with X being partitioned as 



Xq 


T r 


. m _ 





X\\ X\2 
Xi 2 X22 



Xq 



X 



X\\ X\2 
X12 X22 



We know that 

£(0) = m(0) + w = G^B^Xq + w = -{X 2 2 1 X^ 2 + DB~ 1 )x Q + w . 
Thus, the cost of the optimal control design Jp(K*(P)) becomes 



x 



-{X22 X(2 + DB- 1 )x + w Q 





T r 


X 




. W( > 






T r 


Xq 




. W( > 





% T 2 
C22 



Xn X\2 

Xi 2 X22 

— 1 ; 



Xn — X\2X 2 2 X 12 ~1~ O Uj\22 



Xq 

-(X^XT+DB-^xo+wv 
-1 _ n-l 



B-'DX 22 DB-' -B- L DX 22 
— X22DB ^ X- 



l22 



Xq 
Wq 



£T 1 (X 22 + DX22D - IjB- 1 -B- Y DX 2 2 
—X22DB~ 1 X2 



L22 



Xo 
Wq 



(20) 



The second equality is true because of the following equation extracted from 
the discrete algebraic Riccati equation in (|15l) 



X22 — I + BX\\B — BX\2X 2 2 l Xi 2 B, 
which is equivalent to 

X\\ — X\2X 22 X^ 2 = B 1 (X22 — I)B 1 . 



(21) 
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Using (|19p . it is evident that 

X 22 > B[A T (I + B 2 )-^ + I]B + I = BWB + I, 
and as a result, the inner-matrix in (|20l) is lower-bounded by 



B~ 1 (X 2 2 + DX22D - 7)_B _1 -B~ 1 DX 2 2 
—X22DB 1 X22 

B-\X 2 2- IjB- 1 





B- l DX 22 DB- 
-X22DB- 1 



X 2 



> 



B- 1 (X 2 2-I)B- 1 0" 




' -B^D 





+ 


I 


B- 1 (BWB)B- 1 " 


+ 


' -B~ l D ' 







I 



-B~ L DX 22 
X22 

-B~ X D 17 



(BWB + I) 



W + DWD + D 2 B~ 2 -D(WB + B- 1 ) 
-(BW + B'^D BWB + I 



Finally, we get 
J P (K*(P)) > 



Wq 

Bw 



W + DWD + D 2 B- 2 -D(WB + B- 1 ) 
-{BW + B- l )D BWB + I 



W + DWD + D 2 B~ 2 
-(W + B- 2 )D 



This statement concludes the proof. 



-B- X D 
I 



-D(W + B- 2 ) 
W + B- 2 



X 
Wq 

Bw Q 



3.2 Deadbeat Control Design Strategy 

In this subsection, we introduce the deadbeat control design strategy and cal- 
culate its competitive ratio. 

Definition 3.1 The deadbeat control design strategy T A : A(S-p) x B(e) xD-^ 
JC is defined as 



T A (A,B,D) 



D 



—B~D 



-B-\A + D) 



It should be noted that using the deadbeat control design strategy, irre- 
spective of the value of the initial state Xq and the initial disturbance wo, the 
closed-loop system reaches the origin in just two time-steps. The closed-loop 
system with deadbeat control design strategy is shown in Figure |3ja) . This 
feedback loop can be rearranged as the one in Figure [3jb) which has two sepa- 
rate components. One component is a static deadbeat control design strategy 
for regulating the state of the plant and the other one is a deadbeat observer 
for canceling the disturbance. This structure is further discussed in Section H2 
where it is shown that it corresponds to proportional-integral control in some 
cases. First, we need to calculate an expression for the cost of the deadbeat 
control design strategy. 
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w(/c) 



wQc) 





Plant 


3 






















xAk + 1) = DxAk) - B^D 2 


x(k) 






(a) 


u(fe) = x„(/c) - B-^A + D)x(k) 





u 2 (k) 



Plant 



x(k) 



(/.) 



x E {k + 1) = Dx E (/c) 
u 2 (fc) = x s (fc)-j 



B- 1 D 2 x{k) 
^Dxik) 



Figure 3: The closed-loop system with (a) the deadbeat control design strategy 
r A , and (b) rearranging this control design strategy as a static deadbeat control 
design and a deadbeat observer design. 



Lemma 3.3 The cost of the deadbeat control design strategy T A for each plant 
P = (A,B,D,x ,w ) eV is 



J P (T A (A,B,D)) = 



Xq 


T 


' Qn 


Ql2 ' 




Xq 






Ql2 


Q22 _ 




Bw 



whe 



T r>-2 



Qn = I + D\l + B ) + A 1 B~ Z A + DA 1 B 
Q12 = -D - A T B~ 2 - DB~ 2 - DA T B~ 2 A, 
Q22 = A T B~ 2 A + B~ 2 + I. 



AD + A 1 B- Z D + DB- 2 A(22) 

(23) 
(24) 



Proof: First, it should be noted that the state of the closed- loop system with 
T A (A,B,D) in feedback reaches the origin in two time-steps. Now, using the 
system state transition, one can calculate the deadbeat control design strategy 
cost as 

Jp(T A (A, B, D)) = x^x Q + (u(0) + w Q ) T (u(0) + w Q ) 

+ .T(l) T a;(l) + (u(l) + w(l)f(u(l) + w(l)), 

where x(l) = -Dx + Bw , u(0) = -B- 1 (A + D)x , and u(l) = -B~ 1 {A + 
D)x(l) — B~ 1 D 2 xo. The rest of the proof is a trivial simplification. ■ 

We need the following lemma in order to calculate the competitive ratio 
of the deadbeat control design strategy T A when the control graph G/c is a 
supergraph of the plant graph G-p. As the notation K*(P) is reserved for the 
optimal control design strategy for a given control graph Gx, from now on, we 
will use to denote the centralized optimal control design strategy (i.e., the 
optimal control design strategy with access to full-state measurement). 

Lemma 3.4 Let Gk. H G-p, and P = (A, B, D,x ,w ) E V be a plant with A 
being a nilpotent matrix of degree two. Then, Jp(K*(P)) = Jp(K^,(P)). 

Proof: When matrix A is nilpotent, the unique positive-definite solution of 
the discrete algebraic Riccati equation ([T5|) is 



X 



A T A + I A T B 

BA BA T (I + B 2 )- 1 AB + I + B 2 
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Consequently, the optimal centralized controller gains in (|14[) are 

Gi=0, G 2 = -(I + B 2 )- 1 BAB-D, 
and as a result, the optimal centralized controller Kq(P) is 
D 



K* C (P) 



D(I + B 2 )~ 1 B~ 1 A — B~ 1 D 2 
-{I + B 2 )~ L BA- B- L D 

(zl - D)~ 1 D(I + B 2 )~ 1 B~ 1 A - B~ 1 D 2 - (I + B^BA - B^D. 



Thus, Kq(P) £ IC(Sic) because the control graph Gjc is a supergraph of the 
plant graph Gp. Now, considering that K*(P) is the global optimal decen- 
tralized controller, it has a lower cost than any other decentralized controller 
K £ JC(S)c), specially K^(P) £ K.(S/c) for this particular plant. Hence, 



J P {K*{P)) < Jp{K* c {P)). 
On the other hand, it is evident that 

Jp(K* c (P)) < J P (K*(P)). 

This concludes the proof. 



(25) 



(26) 



Remark 3.1 Finding the optimal structured controller is intractable in general, 
even when the global model is known. In this paper, we concentrate on the cases 
where the control graph G/c is a supergraph of the plant graph G-p, because it is 
relatively easier to solve the optimal control design problem under limited model 
information in this case. In addition, although, in this paper, we may not be 
able to find the optimal structured controller K*(P) for a particular plant in 
some of the cases, we can still compute the competitive ratio r-p. Thus, in a 
sense, this makes the competitive ratio a quite powerful tool. 

Next, we derive the competitive ratio of the deadbeat control design method. 

Theorem 3.5 Let Gx. 12 Gp. Then, the competitive ratio of the deadbeat con- 
trol design method T A is equal to 



A 2e 2 + l + vwtt 
Mr ) = - 2 . 

Proof: First, let us define the set of all real numbers that are greater than 
or equal to the competitive ratio of the deadbeat control design strategy 

M r*(A,B,D)) < 
Jp(K*{P)) " P? 



M = £ 

It is evident that 

J P (K*c(P)) < Jp(K*(P)) 
for each plant P £ V irrespective of the control graph G/c, and as a result 

J P (T A (A,B,D)) J P (T A (A,B,D)) 

Jp(K*{P)) ~ Jp(K* c {P)) ■ [ > 
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Using (|2"Tf and Lemmas 13.31 and I3~2l (3 belongs to the set M if 



x 


T 


' Qu 


Ql2 ' 




x 


Bw 




Ql2 


Q22 _ 




Bw 



x 

Bwq 



W + DWD + D 2 B- 2 -D(W + B- 2 ) 1 [ x 
-{W + B- 2 )D W + B- 2 [ Bw 

(28) 

for all A G A(S V ), B G B(e), D e V, x G R n , and w G R n where Q U) Q12, 
and Q22 are matrices defined in ((22]) -(124 )) . The condition (|28[) is satisfied, if and 
only if, for all A G A(S V ), B G S(e), and D G X>, we have 



-2\n _ nT 



/3D(W + B- 2 ) - Q u 



> 0. 



(29) 



Using Schur complement [24], /3 belongs to the set A4 if 

Z = (3(W + B~ 2 ) - Q 22 

= (3(A T (I + B 2 Y X A + I + B- 2 ) - A T B- 2 A - B^ 2 - I 
= A T ((3{I + B 2 )- 1 - B- 2 )A + {fi- 1)(B- 2 +/) > 0, 

and 

- [-/3D(W + B- 2 ) - Q 12 ] [/3(W + B- 2 ) - Q 22 ] ~ l [-f3(W + B- 2 )D - Q T 12 ] 

+f3(W + DWD + D 2 B- 2 )-Qu>0, (30) 

for all A G A(S-p), B G B(e), and D G V. We can do the simplification 

- f3D{W + B~ 2 ) - Qi 2 = ~(3D{A T {I + B 2 )- 1 A + I + B~ 2 ) 

-(-D - A T B- 2 - DB- 2 - DA T B~ 2 A) 

= -((3-l)D(I + B- 2 ) + A T B- 2 

-DA T ((3(I + B 2 )- 1 - B~ 2 )A 

= -DZ + A T B~ 2 , 

and as a result, the condition (I30[) is equivalent to 

P(W + DWD + D 2 B- 2 )-Q 11 -[-DZ + A T B- 2 ]Z- 1 [-ZD + B- 2 A] > 0, (31) 

where Z is defined in (|2"9"]l . Furthermore, we can simplify (3(W + DWD + 
D 2 B- 2 ) - Q n as 

A T ((3(I + B 2 )- 1 - B- 2 )A + (J3-1)[I + D 2 B-' 2 + D 2 } 

+DA T ((3(I + B 2 )- 1 - B- 2 )AD - A T B^ 2 D - DB- 2 A, 

which helps us to expand condition (|31[) to 

A T (0(1 + B 2 )- 1 - B- 2 ) A +(/? - 1) (I + D 2 B- 2 + D 2 ) 

+DA T ((3(1 + B 2 )- 1 - B- 2 ) AD - A T B^ 2 D - DB- 2 A 
-D (A T (13(1 + B 2 )- 1 - B- 2 ) A +(13- l)(B- 2 + I)) D 
+A T B- 2 D + DB- 2 A - A T B- 2 Z- 1 B- 2 A > 0. (32) 
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Hence, it follows from (f3"2"j) that ([31]) can be simplified as 

A T (/3(J + B 2 )^ 1 - B~ 2 ) A - A T B- 2 Z- 1 B- 2 A > 0. (33) 

The condition ((29)) is satished, for all plants P G T 3 , if/3 > 1 + 1/e 2 , since in 
this case j3(I + B 2 )^ 1 — B~ 2 > (recall that any matrix B is diagonal and its 
diagonal elements are lower-bounded by e). Furthermore, for all j3 > 1 + 1/e 2 , 
it is easy to see that Z > {fi — 1)(B~ 2 + 1). As a result, it can be shown that 
the condition (|33l) is satisfied if 

A T (/3(I + B 2 )- 1 - B- 2 -[fi- l)- 1 ^- 2 ^- 2 + I)- 1 B- 2 ) A+(J3-1)I> 0. 

(34) 

Now, the condition (|34|) is satisfied if 



/3(I + B 2 )- 1 - B- 2 -{13- \y x B- 2 (B- 2 + iy l B- 2 > 0. (35) 
Noting that the matrix B = diag(&u, . . . , b nn ), one can rewrite (|35p as 

P J_ 1 1 ^ n 

l + bi b% P-lbl(l + bl)- U - W 

for all bu > e. Retracing our steps backward, it easy to see that the set 



P I P > 1 + \ and {35) satisfied) = J p > 2f2 + 1 + ^ 4e2 + 1 I c M. 



2r 2 



Therefore, we get 



A J P (T A (A,B,D)) 2e 2 + 1 + VWTT 
MT ] = MK*(P)) ^ 2? ' (37) 

Now, we have to show that this upper bound can be achieved by a family of 
plants. Consider a one-parameter family of matrices {A(r)} defined as A(r) = 
rejef for each r G K. It is always possible to find indices i and j such that 
i 7^ j and (s-p)ji ^ 0, because of the assumption that there be no isolated node 
in the plant graph. Let B = el and D — I. For each r G R, the matrix A(r) is 
a nilpotent matrix of degree two, that is, A(r) 2 = 0. Thus, using Lemma \'3. 41 
we get 

J P (K* C (P))=J P (K*(P)) 

for this special plant. The solution to the discrete algebraic Riccati equation 
in (HHD is 

A{r) T A(r)+I eA(r) T 



X -- 

Thus, if we assume that 



eA(r) e 2 /(l + e 2 )A{r) T A{r) + (e 2 + 1)1 



(e 2 + l)(VW+l + l) 

xq = ei, (38) 

Zer 



and 



(e 2 + l) (V4?T T+l) 
2e 2 r 



w = t^JZ e i ~ e ji (39) 
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the cost of the optimal control design strategy is 



(e 2 + l)V4e 2 + 1 + 5e 2 + 4e 4 + 1 

2e 2 

(2e 2 + V4e 2 + 1 + l)\/4e 2 + 1 



jp(if(p)) = vc \:r ^ ^ (40) 



2e 2 r 2 

and the cost of the deadbeat control design strategy is 



M rHA,B, D)) = (^ + l)(3 £ 2 V4?TT + 5e 2 + 4 £4 + V4?TT + l) 

->< ' (41) 



(e 2 + l)(6 2 V4e 2 + 1 + eV4e 2 + 1 + e 2 + 3e 4 + 2e 6 ) 
+ 2e 4 r 2 
This results in 

J P (T A (A,B,D)) 2e 2 + 1 + VW+T 
^ J P (^(P)) = 2? ' (42) 

Equation (j3"7| together with ((32) conclude the proof. ■ 



Remark 3.2 Consider the limited model information design problem given by 
the plant graph G-p in Figure [Ufa J and the control graph Gjc in Figure \$(b). 
Theorem 13.51 shows that, if we apply the deadbeat control design strategy to this 
particular problem, the performance of the deadbeat control design strategy, at 
most, can be (2e 2 + 1 + v4e 2 + l)/(2e 2 ) times the cost of the optimal control 
design strategy K* . In fact, Theorem \S. 5\ states that this relationship between 
the performance of the deadbeat control design and the optimal control design 
with full model information holds for a rather general class of systems. For the 
case that B = {I}, the relationship is given by (3 + y/E)/2 ~ 2.62, so the deadbeat 
control design strategy is never worse than two or three times the optimal. 

With this characterization of T A in hand, we are now ready to tackle prob- 
lem ©. 



4 Plant Graph Influence on Achievable Perfor- 
mance 

In this section, we study the relationship between the plant graph and the 
achievable closed-loop performance in terms of the competitive ratio as a per- 
formance metric and the domination as a partial order on the set of limited 
model information control design strategies. To this end, we first state and 
prove two lemmas which will simplify further developments. 

Lemma 4.1 Fix real numbers a G R and b € M. For any x € K, we have 
x 2 + {a + bx) 2 >a 2 /{l + b 2 ). 

Proof: Consider the function x x 2 + (a + bx) 2 . Since this function is both 
continuously differentiable and strictly convex, we can find its unique minimizer 
as x — — ab/(l + b 2 ) by setting its derivative to zero. As a result, we get 

x 2 + (a + bx) 2 >x 2 + {a + bx) 2 = a 2 /(l + b 2 ). 

This concludes the proof. ■ 
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Lemma 4.2 Let the design graph Gq be a totally disconnected graph, and Gk: 2 
G-p. Furthermore, assume that node i is not a sink in the plant graph Gp. 
Then, the competitive ratio of a control design strategy T £ C is bounded only if 
o-ij + bu(dr)ij(A, B, D) — for all j ^ i and all matrices A € A(Sp), B G B(e), 
and DeV. 

Proof: The proof is by contrapositive. Let us assume that there exist 
matrices A E A(Sp), B € 8(e), D 6 T>, and indices i and j such that i ^ j and 
Sij + bu(dr)ij {A, B , D) ^ 0. Let 1 < I < n be an index such that £ ^ i and 
{sp)u 7^ (such an index always exists because node i is not a sink in the plant 
graph G-p). Define matrix A such that Ai = Ai, Ai = ref , and A t = for all 
t ^ i,£. Because the design graph is a totally disconnected graph, we know that 
Ti(A, B,D) = Ti(A, B, D). Using the structure of the cost function in ([7]) and 
plant dynamics in ([1]), the cost of this control design strategy for wq = ej and 
xq = is lower-bounded by 

J(A,B,D,o,ej)(T(A, B , D)) > (u e (2)+w e (2)) 2 + x/(3) 2 

= M2) + w e (2)) 2 + (rx42) + b u [u e (2) + w e {2)]f . 

Based on Lemma 14.11 and the fact that Xi(2) = (<z,j + bu(dr)ij(A, B, D))bjj 
(see Figure 01), we get 

J (A ,B,n,o,e,)F(A,B,D)) > r 2 Xl (2) 2 /{l + b 2 u ) 

= {an + b u (dr)ij(A, B, D)) 2 b 2 3 r 2 /(1 + b 2 u ). 

On the other hand, the cost of the deadbeat control design strategy is 

^,s,A0,e 3 )(r A (AS,Z?)) = ejB T (A T B- 2 A + B- 2 +I)Be 3 

= b l + l + 4 b n/ b l 

Note that the deadbeat control design strategy is applicable here since the con- 
trol graph Gjc is a supergraph of the plant graph Gp. This gives 

Jp(T(A,B,D)) 
^ = J P (K*(P)) 



sup 

Pev 



Jp(T(A,B,D)) J P (T A (A,B,D)) 



J P (T±(A,B,D)) J P (K*(P)) 



Jp(T(A,B,D)) 

* p7v MTHAB,D)) W 
(a ll+ bu(drh(AB,D)) 2 bl/(l + b 2 u ) 

~ b 2. + l + a 2_ b 2_ /b 2, }Too r ' =0 °- 

33. ~ V 33 1 « 

This inequality proves the statement by contrapositive as the competitive ratio 
is not bounded in this case. ■ 



4.1 Plant Graphs without Sinks 

First, we assume that there is no sink in the plant graph and try to charac- 
terize the optimal control design strategy in terms of the competitive ratio and 
domination. 



IS 



iv(0) = w 




w(l) = Dw 




w(2) = D I w„ 








\ 


x(0) = 




x(l) = Bw„ 




x(Z) = (il + BD r + O)Bm/ 
























*„((>) = 






*nm = 






x K (2) = B r Bw„ 
















4 / 




-+ / 


u(0) = 




u(l) = D r Bw 




u(2) = C r B r l(l) + D r x(2) 





Figure 4: State evolution of the closed-loop system with any control design 
strategy T when xq = 0. 

Theorem 4.3 Let the plant graph Gp contain no sink, the design graph Gq be 
a totally disconnected graph, and Gjc 3 G-p . Then, the competitive ratio of any 
control design strategy T € C satisfies 



„ 2e 2 + 1 + s/i^+T 

Mr) > ^ ■ 

Proof: Consider a one-parameter family of matrices {A(r)} defined as 
A(r) — rejef for each r € K. It is always possible to find indices i and j 
such that i j and (s-p)ji 7^ 0, because of the assumption that there is no 
isolated node in the plant graph. Let B = el and D = I. Let F e C be a 
control design strategy with design graph Gq- Without loss of generality, we 
can assume that "fji(A, B, D) = —r/e since otherwise, using Lemma H~2l we get 
that r-p(T) is infinity, and as a result the inequality in the theorem statement is 
trivially satisfied. Thus, for each r <E R, the cost of the control design strategy 
F for xo in (|3"51) and wo in (f3l?|) is lower-bounded by 

Jp{T{A,B,D)) > ( Uj (0) +w J (0)) 2 + x J (l) 2 



(e 2 + l)(V4? + T+l) 
2e 2 



c 2 



(e 2 + l)(3eV4e 2 + 1 + 5e 2 + 4e 4 + V4e 2 + 1 + 1) 
2? ' 

On the other hand, for each r € M, the matrix A(r) is a nilpotcnt matrix of 
degree two, that is, A{r) 2 = 0. Consequently, using Lemma I3T41 the cost of the 
optimal control design strategy K*{P) for xo in (j3"5j) and wo in (j3"9"j) is given 
by (|30)l. This results in 



J P (r(A,B,D)) 2e 2 + 1 + V4?TT 
rp(r) " 2%, J P (K*(P)) = 2e^ ' 



Theorem 14.31 shows that the deadbeat control design method T 
imizer of the competitive ratio rp as a function over the set of limited model 
information design methods C. The following theorem shows that it is also un- 
dominated by methods of this type, if and only if, the plant graph Gp has no 
sink. 

Theorem 4.4 Let the design graph Gq be a totally disconnected graph, and 
G/c 3 Gp . Then, the control design strategy T A is undominated if and only if 
there is no sink in the plant graph Gp. 
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Proof: First, we have to prove the sufficiency part of the theorem. Assume 
that there is no sink in the plant graph. For proving this claim, we are going 
to prove that for any control design method r £ C \ {T A }, there exists a plant 
P = (A,B,D,x ,w ) £ V such that J P (T(A, B, D)) > J P {T A (A, B, D)). First, 
assume that there exist matrices A £ A(S-p), B £ B(e), and D £ T> and an index 
j such that Aj + bjj(Dr)j(A, B, D) + djjej ^ 0. Without loss of generality, we 
can assume that ajj + bjj(dr)jj(A, B, D) + djj =/= 0, because otherwise, using 
Equation (|43[) in the proof of Lemma [4.21 we know that, if there exists £ ^ j 
such that a,ji + bjj(dr)ji(A, B, D) ^ 0, the ratio of the cost of the control 
design strategy T to the cost of the deadbeat design strategy T A is unbounded. 
Therefore, the control design strategy T cannot dominate the deadbeat control 
design strategy T A . Pick an index i ^ j such that (s-p)ij ^ 0. It is always 
possible to pick such index i because there is no sink in the plant graph. Define 
matrix A such that Aj = Aj, Ai — rej , and At — for all I ^ i,j. It 
should be noted that Tj(A, B, D) = T^yl, B, D) because the design graph is a 
totally disconnected graph. We know that r + bu(dr)ij(A, B, D) = because 
otherwise the control design strategy T cannot dominate the deadbeat control 
design strategy. The cost of this control design strategy for w = ej and xq — 
satisfies 

J P (T(A, B, D)) > (ui(l) + Wl (l)) 2 + (ui(2) + Wl {2)f + Xl {'df 

= r 2 b%/bl + («((2) + Wl (2)) 2 + ( Xj (2)r + b u [ Ui (2) + w t (2)}) 2 , 

because of the structure of the cost function ([7]) and the plant dynamics |T]). 
Now, using Lemma |4. 11 we have 

J P (T(A, B, D)) > r 2 b%/bl + x J (2) 2 r 2 /(l + b 2 u ). 

As a result 

J P (T(A,B,D))- J P (T A (A,B,D)) (44) 
> (A^ + b n {d T ) n {A, B, D) + djjfb%r 2 /{l + bl) - {b% + 1 + 4), 

since Xj(2) = (Ajj + bjj(dr)jj(A, B, D) + djj)bjj (see Figure 2]) and 

<W,A0,e 3 )(r A (A£,£)) = ejB T (A T B- 2 A + B- 2 + I)Be 3 

= bl + l+rH^/bl+a^j. 

Thus, if we pick r large enough, the difference in (|44[) becomes positive, which 
shows that the control design strategy T cannot dominate the deadbeat control 
design strategy T A . Now, assume that there exist matrices A £ A(S-p), B £ 
B(e), and D £ T> and an index j such that Aj + bjj(Dr)j(A, B, D) + djjej = 
but Tj(A,B,D) ^ Tf(A,B,D). Define matrix A such that Aj = Aj and 
At — for all £ ^ j and matrix D as djj = djj and du — for all £ ^ j. Let 
xq = 0. If there exists an index i ^ j such that 7y (A B, D) ^ j A (A,B,D) 
pick wq = e^, otherwise, pick wq = ej. For this special case, the state of the 
closed-loop system with the controller T(A, B, D) is equal to the state of the 
closed-loop system with the controller T A (^4, B, D) for the first and the second 
time-steps (see Figure 2] and Figure [5]). As a result, the state of the subsystem 
j reaches zero in two time-steps. Now, since T j(A, B, D) ^ T A (A, B, D), in 
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the next time-step the state of the subsystem j becomes non-zero again. This 
results in a performance cost greater than the performance cost of the control 
design strategy T A . Thus, the control design T A is undominated by the control 
design method T. 

Now, we have to prove the necessary part of the theorem. Proving this part 
is equivalent to proving that if there exists (a sink) j such that for every i j, 
(s-p)ij = 0, then there exists a control design strategy T which can dominate 
the deadbeat control design strategy. Without loss of generality, let j = n; i.e., 
assume that (s-p)j„ = for all i 7^ n. In this situation, we can rewrite the 
matrix A as 

an • • • ai,n-i 



.4 



a-nl 



0*n-l,n-l 
^n,n— 1 ^™ 



Define x = [xi(0) ••• x n ^i(0)] T and wo = [wi(0) ■■■ u;„_i(0)] T . Let 
T(A, B, D) be defined as A r (A, B, D) = D, C r (A, B, D) = I, 



B r (A,B,D) 











Dr{A,B,D) = 





(&r)ni •• 

ail+rfll 
611 



b n -l, n - 

(rfr)ni 



~ 7"- 1 -"- 1 

O n — l,n-l 

(br)n,n-i {br) 

_ Ql.n-l 

bll 

On-l.n-l+dn-l. 



(dr)n,n- 





(dr)r 



where B r = [(&r)ni ■ ■ • (&r)nn] and £> r = [(dr)ni ■ ■ • (dr) nn ] are tunable gains 
for the last subsystem. We denote the cost of applying the deadbeat controller 
to subsystems 1, . . . ,n — 1 by JP^ B D Sq Wo y This cost is independent of the 
control design parameters Br and Dr, because the last subsystem is a sink and 
it cannot affect the other subsystems. The overall cost of the controller is 



Ji 



(A,B,x ,w ){?{A,B 1 D)) - J { (2,B,D,x ,w ) + J (A,B,D,x 0}Wo )i B r^^ ' 



(2) 



Dr 



where J, 



(2) 



(A,B,D,xo,w a ) y 



j(Br,Dr) is the cost of the controller designed for the last 
(2) ~ ~ 

subsystem. This cost J^ A B D xg wg ^(Br, Dr) is independent of the rest of the 
system's model, because the deadbeat (for subsystems 1,. . .,n— 1) cancel out 
all dependencies in matrix A, thus, one can design the optimal controller for 
the lower part of the system without the model information of the upper part. 
Now, we can use the method mentioned in Subsection 13. 1 1 to design the optimal 
controller for the lower part and find the optimal gains 



By 



((a + l)A n 



D rj 



Dr 



1 



{aA n - D n 



where 



bnn + a nn + 1 + \/ a nn + ^nrfinn 



2aL 



«L + 262, 
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Figure 5: State evolution of the closed- loop system with deadbeat control design 
strategy T A when xq = 0. 



Note that this new control design strategy is always applicable since the control 
graph Gjc is supergraph of the plant graph G-p. Therefore, there exists a control 
design strategy which satisfies 

J(a,b,d,x ,w ){F{A,B,D)) < J( ABDxo Wo ){r A (A,B,D)), 

for all matrices A £ A(S-p), B £ B(e), and D £ T> and all vectors xq £ M™ and 
wo £ M". Consider the matrix A £ A(S-p) such that A n — re^ and At = for 
all £ 7^ n. Let B — el and D = I. For this special system, for all r > 0, we have 



J { A,B,D,0,e n )(r(A,B,D)) = 



Vr 4 + 2r 2 e 2 - 2r 2 + e 4 + 2e 2 + 1 



1 



e 2 + l 



= J { A,B,D, ,e n )(r A (A,B,D)). 

Thus, the control design strategy T dominates the deadbeat control design strat- 
egy r A . ■ 

Remark 4.1 Consider the limited model information design problem given by 
the plant graph G' v in Figure\^a! '), the control graph G'^ in Figure\^b'), and 
the design graph G' c in Figure\^c' ). Theorems \4.3\ and \4-4\ show that the dead- 
beat control design strategy T A is the best control design strategy that one can 
propose based on local model of the subsystems and the plant graph, because the 
deadbeat control design strategy is the minimizer of the competitive ratio and it 
is undominated. 

We use the construction in proof of the "only if" part of Theorem l4.4l to build 
a control design strategy for the plant graphs with sinks in the next subsection. 



4.2 Plant Graphs with Sinks 

In this section, we study the case where there are c > 1 sinks in the plant graph. 
By renumbering the sinks as subsystems number n — c + 1, • • • , n the matrix 
S-p can be written as 



(Sv)n 


0( 9 - c )x(c) 


(Sv)21 





(45) 



where 



(Sv) 



li 



(s-p)u 

{sv)n~cS 



(Sp)l,n- 



n—c,n—c 
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and 



{Sv)21 — 



(sv)n-c+l,l 

(sv)n,l 
(sp)n-c+l,n-c+l 





(«5"p)n— c+l,rt— c 

('ST 1 ')?!,?! — C 



(Sp)rni 



From now on, without loss of generality, we assume that the structure matrix is 
the one defined in (14"5"1) . The control design method T e for this type of systems 
is defined as 



T e (A,B,D) 
where 



D 



B- l D{F(A, B) + I) A - B- l D 2 



B- l (F(A,B)A- D) 
F(A, B) = diag(0, . . . , 0, f„- c+ i(A, B), ... , f n (A, B)) 



, VP e V, 



(46) 



and 



fi(A,B) 



b% + ai + 1 + + ^'i'' 1 , - 24 + 64+26^ + 1 



(47) 



for all i = n — c + 1, • • • , n. 

The control design strategy T e applies the deadbeat to every subsystem 
that is not a sink and, for every sink, applies the same optimal control law as if 
the node was isolated. We will show that when the plant graph contains sinks, 
the control design method T has, in the worst case, the same competitive 
ratio as the deadbeat strategy. However, unlike the deadbeat strategy, it has 
the additional property of being undominated by limited model information 
methods for plants in V when the plant graph G-p has sinks. 

Theorem 4.5 Let the plant graph G-p contain at least one sink, and Gtc 3 G-p. 
Then, the competitive ratio of the design method T e introduced in J^6p is 



rp(T C - 



2c 2 + l + \/4e 2 +l 
1, 



if (Sp)n ^ is not diagonal, 

if both (Sp)n = and (SV>)22 = 0. 



Proof: Based on Theorem 13.51 we know that 

2e 2 



J{A,B,D,x Q ,w ){K*{P)) > 



--J, 



(A,B,D,x ,wo) 



(T A (A, B, D)), (48) 



2e 2 + 1 + V4e 2 + 1 
and by the proof of the "only if" part of Theorem 14.41 we know that 

J {A (T A (A,B,D)) > J {A (T e (A,B,D)), (49) 

for all x e R™ and w e E n . Putting (gHJ) into (ggj results in 

2e 2 



J(A 

(K*(P))> 



J {A ,B ,D ,xq,wq) 



2e 2 + 1 + V4e 2 + 1 
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and, therefore, in 

J{A ,B .D,xq,wq) 



< 



2e 2 



VP = (A,B,x ,w) e V. 



(K*{P)) 

As a result 

J(A,i, X0 , w )(T e (A, B, D)) ^ 2e 2 + 1 + V^+l 



r P (r w ) = sup 



PEV 



Jt 



(A, I ,xq,w 



< 



2c 2 



If (S-p)n has an off-diagonal entry, then there exist 1 < i, j < n — c and i =/= j 
such that (s-p)ij ^ 0. Define A(r) such that A(r) = rejef. In this case, using 
the proof of Theorem 14.31 we know 



Mr* 



2e 2 + 1 + V4e 2 + 1 
2? : 



because the control design T e acts as the deadbeat controller on that part of 
the system. Using both these inequalities proves the statement. 

If (S-p)ii = and (5*73)22 = 0, every matrix A with structure matrix (S-p) is 
a nilpotent matrix of degree two. Thus, using Lemma 13.41 we get 

J P (K*(P)) = J P (K* C (P)). 

Now, based on the proof of Lemma I3T41 we also know that the optimal controller 
gain for this plant model is 



K* C (P) 



D 



D(I + B 2 )~ 1 B~ 1 A — B~ 1 D 2 
-{I + B'^BA- B^D 



For control design strateg y T e , we will have 



T e (A,B,D) 



D 



I 
D 



B- 1 D{B{I + B 2 )- l B - I)A - B- l D 2 



B^ 1 (B(I + B 2 )~ 1 BA — D 
D(I + B 2 )- 1 B~ 1 A- B- X D 2 



(I + B 2 Y Y BA- B^D 



based on (|46]). Thus, r v (T ) = 1. 



Theorem 4.6 Let the plant graph G-p contain at least one sink, the design 
graph Gq be a totally disconnected graph, and G/c 2 G-p. Then, the competitive 
ratio of any control design strategy T £ C satisfies 



rp(T) > 



2e 2 + 1 + V4e 2 + 1 
2? : 



if (S-p) 11 is not diagonal. 



Proof: First, suppose that (Sp)n 7^ and (5*73)11 is not a diagonal matrix, 
then there exist 1 < i,j < n — c and i 7^ j such that (s-p)ij 7^ 0. Consider the 



family of matrices A(r) defined by A(r) = re^ej. Based on Lemma [4.21 if we 
want to have a bounded competitive ratio, the control design strategy should 
satisfy r + bu(dr)ij(A(r), B, D) = (because node 1 < i < n — cis not a sink). 
The rest of the proof is similar to the proof of Theorem 14.31 ■ 
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Remark 4.2 Combining Theorem \4-5\ and Theorem \4-6\ implies that if (S-p)n ^ 
is not diagonal (i.e., the nodes that are not sink can affect each other), control 
design method T e is a minimizer of the competitive ratio over the set of limited 
model information control methods and consequently a solution to the problem 
(0). Furthermore, if(S-p)n and (S-p)22 are both zero, thentheT® becomes equal 
to K* , which shows that, T e is a solution to the problem in this case too. 
The rest of the cases are still open here. 

The next theorem shows that T is a more desirable control design method 
than the deadbeat when plant graph Gp has sinks, since it is then undominatcd 
by limited model information design methods for plants in V . 

Theorem 4.7 Let the plant graph Gp contain at least one sink, the design 
graph Gq be a totally disconnected graph, and Gx 3 G-p. Then, the control 
design method T e is undominated by all limited model information control design 
methods. 

Proof: Assume that there are c > 1 sink in the plant graph. For proving this 
claim, we are going to prove that for any control design method T 6 C\{r e }, 
there exits a plant P = (A,B,D,xq,w ) e V such that Jp(T(A, B, D)) > 
Jp(T 6 (A, B, D)). We will proceed in several steps, which require us to partition 
the set of limited model information control design strategies C as follows 

C = W 2 U Wi U Wo u {r A }, 

where 

W 2 := {r e C | 3j, n - c + 1 < j < n, such that Tj(A, B, D) ^ Tf(A, B, D)}, 

Wi := {r e c\m\ aj, i < i < n - c, 

and 3Pe V,(D r )j(A,B,D) + (D®)j(A,B,D)}, 

and 

Wo := {r e C \ W 2 U Wi I 3j, 1 < j < n - c, BP e V, 

such that Tj(A,B,D) ^ Tf{A,B,D)}. 

First, we prove that the T is undominated by control design strategies 
in W2- We assume that there exist index n — c + 1 < j < n and matrices 
A G A{S V ), B € B{e), D € V such that Tj(A,B,D) ^ rf(A,B,D). Consider 
matrices A and D defined as Aj = Aj and Ai = for all i ^ j and djj = djj 
and da — 0. For this particular matrix A, any xq, and any wq, we know from 
the proof of the "only if" part of Theorem 14.41 that Y (A,B,D,xq,wq) is the 
globally optimal controller with limited model information. Hence, every other 
control design method in C leads to a controller with greater performance cost 
than r e for this particular type of plants. Therefore, the control design r e is 
undominated by control design methods in W 2 - 

Second, we prove that the control design strategy T is undominated by 
the control design strategies in Wi. Let T be a control design strategy in Wi 
and let index 1 < j < n — c be such that Aj + bjj(Dr)j(A, B, D) + djjej ^ 
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for some matrices A £ A(S-p), B G #(e), and D 6 T>. It is always possible 
to pick an index i j such that (s-p)ij ^ because node j is not a sink in 
the plant graph. If 1 < i < n — c, the proof is the same as the proof of the 
"if" part of Theorem 14.41 therefore, without any loss of generality, we assume 
that n — c + 1 < i < n. Again, with the same argument as in the proof of 
the "if" part of Theorem 14.41 without loss of generality, we can assume that 
a jj + bjj(dr)jj(A, B, D) + djj ^ (because otherwise the ratio of the cost the 
control design strategy T to the cost of the control design strategy r e becomes 
infinity). Define matrix A such that Aj = Aj, A.- L — rej , and A# — for all 
I 7^ i, j. Let D 6 T> be such that djj ~ djj and dg — for all I ^ j. It should 
be noted that Tj(A, B, D) = Tj(A, B, D) because the design graph is a totally 
disconnected graph. The cost of this control design strategy for w — ej and 
xq = would satisfy 

J P (T(A, B, D)) > (u,-(l) + Wl {\)) 2 + x % (2) 2 + (u t {2) + Wl {2)) 2 + x t (3) 2 
= r 2 b 2 n /(b 2 l + l) + (u l (2) + w t (2)) 2 

+ {x j {2)r + b ii [u i {2) +w l {2)]) 2 
>(r 2 6f i + : r i (2)V)/(l + ^), 

This results in 

J(A,I,B,D,0, ej )(r(A B, D)) - J(A,/,B,Z5,0,e 3 )(r e (^, B, D)) 

> K" + bji(dr) 3 M> B> D ) + d r jfb%r 2 /{l + b 2 A - n(A 3 ,b 33 ). 

where n(Aj,bjj) is only a function Aj and bjj and represents the part of the 
cost of the control design strategy T e that is related to subsystem j only. If we 
pick r large enough, the difference would become positive, which shows that the 
control design strategy T cannot dominate the control design strategy T . 

Finally, we prove that the control design strategy T e is undominated by the 
control design strategies in Wo ■ The same argument as in the proof of the "if" 
part of Theorem 14. 41 holds here too. ■ 

Remark 4.3 Consider the limited model information design problem given by 
the plant graph G-p in Figure\^(a), the control graph G'^ in Figure\^(b' ) , and the 
design graph G' c in Figure\^(c' ) . Theorems \4-5[ \J1>1 and \4-7\ tog ether show that, 
the control design strategy T e is the best control design strategy that one can 
propose based on local subsystems ' model and the plant graph, because the control 
design strategy T e is a minimizer of the competitive ratio and it is undominated. 

5 Design Graph Influence on Achievable Perfor- 
mance 

In the previous section, we approached the optimal control design under limited 
model information when Gq is a totally disconnected graph. The next step is 
to determine the necessary amount of the model information needed in each 
subcontroller to be able to setup a control design strategy with a smaller com- 
petitive ratio than the deadbeat control design strategy. We tackle this question 
here. 
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Theorem 5.1 Let the plant graph Gp and the design graph Gq be given, and 
G/c D G-p. Assume that the plant graph G-p contains the path i — > j — > £ with 
distinct nodes i, j, and £ while {£,j) ^ Eq. Then, we have 



(r , 2e 2 + 1 + V4^~ 



2e 2 

Proof: Let i, j, and k be three distinct nodes such that (sp)ji ^ and 
(s'p)ii 7^ (i- e -) the path i — > j — > £ is contained in the plant graph Gp). Define 
the 2-parameter family of matrices A(r, s) — rejef + se^ej . Let B — el , D = I , 
and L E C be a limited model information with design graph Gq- The cost of 
this control design strategy for wq = and xq = satisfies 

J ( A,B,Dfl,e,)( T ( A > B > D )) > (Ue(2)+Wt(2)) 2 + Xi (3) 2 

= (u e (2) + w e (2)f + { SXj (2) + e[u e (2) + w e (2)]) 2 , 

because of the structure of the cost function in ([7]) and the system dynamic 
in (Q~]). Now, using Lemma 14.11 and the fact that Xj(2) = (r + e(dr)ji(r))e 
(see Figure 0]), we get 

J ( A,B t D t o, ej )(T(A,B,D)) > s 2 x 3 (2) 2 /(l + e 2 ) 

= (r + e(d r Ur)) 2 e 2 s 2 /(l + e 2 ). 

Note that (dp)ji(r) is only a function of r and not s since (£,j) ^ Eq- On the 
other hand, the cost of the deadbeat control design strategy is 

J ( A,B,AO, ei )(r A (A,B,Z>)) = efB T (A T B- 2 A + B- 2 +I)B ei 

= e 2 + l + r 2 . 

Note that the deadbeat control design strategy is applicable here since the con- 
trol graph G/c is a supergraph of the plant graph Gp. Using (|43|) . we get 

r p (T) > (^^(0)V/(l + e 2 ) Um ^ 

Using (|50l) it is easy to see that the competitive ratio rp(T) is bounded only 
if r + e(dr)ji{r) = 0, for all r € M. Therefore, there is no loss of generality in 
assuming that (dr)ji{r) ~ —r/e because otherwise the rp(T) is infinity and the 
inequality in the statement of the theorem is trivially satisfied. Now, let us fix 
s — and use the notation A(r) — rejef . Since the parameters of the subsystem 
j is not changed and (£, j) Eq, we have (dr)ji{r) = —r/e. Therefore, for each 
r € R, similar to the proof of Theorem l4.3l the cost of the control design strategy 
r for xq in (|38l) and wq in (l39l) is lower-bounded by 

Jp(T(A, B, D)) > ( £2 + 1 ^ 3£2V ^ TT+ g 4 2 + 4£4 + V ^ TT+1 ), 

On the other hand, for each r e R, the matrix A(r) is a nilpotent matrix of 
degree two, that is, A(r) 2 = 0. Similar to the proof of Theorem 14. 31 for xq 
in ([55)1 and u>o in (|31?]) . we get 



r ,i,./ D » (e 2 + l)V4e 2 + l + 5e 2 +4e 4 + l , (2e 2 + ^e 2 + 1 + l)V4e 2 + 1 
MK (P)) = — 2 + ^ , 
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since Jp{K*{P)) = Jp{Kq{P)) according to Lemma I3~4l This results in 



Jp(T(A,B,D)) 2e 2 + 1 + VWTT 

MT) ~ JSSo MKHP)) = 2? ■ 

This hnishes the proof. ■ 

Remark 5.1 Consider the limited model information design problem given by 
the plant graph G'-p in Figure\^a' ), the control graph Gx in Figure\3(b), and 
the design graph Gc in Figure\^c). Theorem \5.1\ shows that, because the plant 
graph G-p contains the path 2 — > 1 — > 4 but the design graph Gc does not contain 
4 — > 1, the competitive ratio of any control design strategy V <E C would be greater 
than or equal to r-p(T A ). 

Remark 5.2 Theorem \5.1\ shows that, when G-p and Gjc is a complete graph, 
achieving a better competitive ratio than the deadbeat design strategy requires 
each subsystem to have full knowledge of the plant model when constructing 
each subcontroller. 



6 Proportional-Integral Deadbeat Control De- 
sign Strategy 

In this section, we use some of the results of the paper on familiar control design 
problems like constant-disturbance rejection and step reference-tracking. 

6.1 Constant-Disturbance Rejection 

For the case of constant-disturbance rejection, we can model the disturbance 
as in @ with matrix D = I. For each plant P = (A, B, I, xo, wq) <E V, the 
deadbeat controller design strategy is 



r A (A B, I) 



This controller can be realized as 



-B~ 



-B-\A + I) 



u(k) = -B^Axik) - B- 1 x(i). 



i=0 

which is a proportional-integral controller. Thus, we call the restricted map- 
ping r c A onst : A{S V ) x B{e) -> JC(S K ), defined as T* nst (A,B) = T A (A,B,I), 
the proportional-integral deadbeat control design strategy. The proportional 
term regulates the states of the system and the integral term compensates for 
the disturbance. For instance, in this case, Theorem 14.31 shows that when the 
plant graph G-p contains no sink and the design graph Gc is a totally discon- 
nected graph, the deadbeat proportional-integral control design strategy is an 
undominated minimizer of the competitive ratio. Note that the integral part of 
this control design strategy is fully decentralized and the proportional part only 
needs the neighboring subsystems state-measurements. 
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6.2 Step Reference- Tracking 



Consider the case that we are interested in tracking a constant reference signal 
r £ R™. We need to define the difference x(k) — x(k) — r which gives 

x(k + 1) = x(k + 1) - r = Ax(k) + Bu(k) - r = Ax(k) + Bu(k) + Ar - r. 

Now if the subsystems do not want to share the reference points with each other, 
we can think of the additional term Ar — r as the constant-disturbance vector 
w(k) = B~ 1 (Ar — r). Thus, we have 

x(k + 1) = Ax(k) + B(u{k) + w(k)). 

The subsystems only need to transmit the relative error between the state- 
measurements and reference points. In this case, we can use the cost function 

oo 

J P (K) = Y,\x{k) T x{k) + (tt(fe) + w{k)f(u(k) + w{k))}, (50) 

to make sure that the error x(k) goes to zero as time tends to infinity. Note that 
if we want to have a complete state regulation lim^oo x{k) = 0, the control 
signal should have a limit as 

lim u(k) = -B~ 1 (Ar - r). 

k— >oo 

Thus, the second term of the cost function (|50p only penalizes the difference of 
the control signal and its steady-state value. 

7 Conclusions 

We studied the design of optimal disturbance-rejection and servomechanism 
dynamic controllers under limited plant model information. We investigated the 
relationship between closed-loop performance and the control design strategies 
with limited model information using the performance metric called competitive 
ratio. We found an explicit minimizer of the competitive ratio and showed that 
this minimizer is also undominated. This optimal control design is a dynamic 
control design strategy composed of a static part for regulating the state of the 
system and a dynamic part for canceling the effect of the disturbance. Possible 
future work will focus on extending the present framework to situations where 
the subsystems and disturbances are not scalar. 
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